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Program Structure 


DURATION © 


Programs that last at least five 
weeks and include at least three 
hours of academic instruction per 
day have been demonstrated to 
generate significant and _ lasting 


CLASS SIZE aes 


Small classes capped at 15 
students per teacher support 
stronger individualized instruction 
and help build relationships in 
academic and enrichment periods. 
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ATTENDANCE 


Attendance is strongest when 
programs communicate — the 
benefits of high attendance during 
recruiting, establish an enrollment 
deadline, and create an engaging 


effects on student achievement. 


Optimally, programs will be 

offered to students for multiple 

summers. 
ENRICHMENT 
ACTIVITIES = 
Engaging enrichment activities that 
take place alongside academics 
can help fill the "opportunity gap" 
and have been shown to reinforce 
regular attendance. 

Personnel 

ACADEMIC ial ENRICHMENT 

TEACHERS vr 


INSTRUCTORS OO 


site climate with positive adult- 
student relationships. 


ACADEMIC 
CURRICULUM LL 


High-quality curriculum materials, 
including lesson plans that align 
with school-year standards and 
student needs, maximize the 
effectiveness of instruction. 
Summer programs are short in 
duration and provide little time for 
teachers to plan their own lessons. 


ADMINISTRATION 3 


Certified teachers with content Enrichment lessons led by In addition to site administrators, 
knowledge and grade-level instructors with content expertise large, centralized summer 
experience enhance instructional are more to engage programs require early and 


quality in academic classes. students. 
Specialized support personnel 


can enhance learning and 


Partnerships — with 
community organizations can 
create opportunity for additional 


comprehensive planning led by a 
half-time summer — program 
director who can begin working 


provide greater continuity across 
the school year for students with 
specialized needs. 


personnel with specific expertise 
in distinctive enrichment activities. 


in January, if not earlier. 
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Voluntary academic summer learning programs can lead to improved student 
achievement, but effectiveness is not guaranteed. 


= The National Academy of Sciences consensus study finds that the content and structure of rigorously 
studied voluntary programs varied by grade level, duration, content, and curriculum; some 
demonstrated academic benefits while others did not. 


o There is evidence of effectiveness of voluntary academic programs across grade levels. 
o There is evidence supporting the effectiveness of both single-subject and multi-subject academic summer 
learning programs. 


= A systematic review using evidence standards outlined by the Every Student Succeeds Act finds 
more “promising” rather than “strong” evidence for voluntary academic summer learning programs, 
although limitations of the evidence-base (e.g., sample size and multiple research site requirements) 
were noted in the synthesis and conclusions. 


= A meta-analysis of experimental and quasi-experimental studies found that children who participated 
in summer programs that included mathematics instruction and enrichment activities had higher 
mathematics achievement compared to control students. 


Program duration, attendance, use of time, and quality of instruction appear to be key 
factors in programs that show stronger academic benefits. 


= A systematic review finds that voluntary academic programs that last for three weeks or less have 
not been effective in producing significant academic benefits. 


m= Much of the most rigorous evidence about voluntary academic summer programs comes from a 
large multi-district, multi-year study conducted by RAND. Findings include: 


o After the first summer, the treatment group (Students offered the program) outperformed control group 
students on fall mathematics assessments; however, the treatment group did not outperform contro! group 
students on spring mathematics assessments or reading assessments in the fall or spring. 

o The subset of students who attended the summer 2013 program for at least 20 days showed stronger effects, 
with gains persisting through spring 2014. After two summers of programming, high attenders outperformed 
the control group in both mathematics and language arts in the fall and on the spring state assessments. 

o Productive academic learning time is more predictive of student achievement than the amount of time summer 
students spend in the classroom. Students who received at least 25 hours of math and 34 hours of language 
arts productive academic learning time in summer performed better on subsequent state exams. However, 
many students failed to hit this bar in voluntary summer programs because intended instructional time was 
easily lost due to late class starts and early dismissals, unproductive time within the classroom, unplanned or 
lengthy transition time between classes, and poor student attendance. 


= A meta-analysis of classroom and home summer reading programs finds positive treatment effects 
for students in summer reading programs that employed research-based reading instruction. 


m Strong attendance is related to positive outcomes across multiple studies. 
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DURATION 
Programs that last at least five weeks and include at least three hours of academic 
(CY) instruction per day have demonstrated significant and lasting effects on student 
achievement. Optimally, programs will be offered to students for multiple summers. 


m= Programs operating for three or fewer weeks have not been found to generate measurable academic 
benefits whereas researchers find lasting effects on students among programs of more than five 
weeks. 


= A longitudinal follow-up study of voluntary summer learning programs offered to students for two 
summers finds that three school years after the second summer of programming, the academic 
advantage attenders held over control group students decreased in magnitude but remained large 
enough to be educationally meaningful. 


CLASS SIZE 
ose Classes with fewer than 15 students per teacher support stronger individualized 
@@® instruction and help build relationships in academic and enrichment periods. 


= Smaller class sizes provide teachers greater ability to work individually with students, build 
relationships, and differentiate instruction based on student needs. 


= Maintaining small class sizes during enrichment programming improves the quality of the enrichment 
experience and helps instructors manage behaviors and routines. 


ATTENDANCE 
Attendance is strongest when programs communicate the benefits of high 
(7) attendance during recruiting, establish an enrollment deadline, follow-up with 
| reminders about the program, provide transportation, and create an engaging site 
climate with positive adult-student relationships. 


m While the average daily attendance in the elementary summer learning programs across the RAND 
study was 75%, there was significant variation by district and site. The site-level average daily 
attendance ranged from 65% to 92%. 


= Several program practices are associated with strong attendance: 
o Communicating the expectations and benefits of strong attendance during recruiting 
o Establishing an enrollment deadline 
o Following-up with reminders about the program 
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°o Creating an engaging site climate with positive adult-student relationships; 
o Providing free transportation and meals can reduce barriers to participation, particularly for students from 
families with low incomes. 


ENRICHMENT ACTIVITIES 
Engaging enrichment activities that take place alongside academics can help fill the 
“opportunity gap” and encourage students to regularly attend the summer program. 


m Successful full-day programs tend to include both academics as well as engaging enrichment 
activities and field trips. 


explicit. 


ACADEMIC CURRICULUM 
High-quality curriculum materials, including lesson plans that align with school-year 
LJ standards and student needs, maximize the effectiveness of instruction. Summer 
programs are short in duration and provide little time for teachers to plan their own 
lessons. 


m= Providing academic teachers aligned curriculum materials (including lesson plans) helps teachers 
maximize productive academic learning time and teach more content and improves teacher 
satisfaction with the program. 


m Unsurprisingly, teachers who receive hands-on training and practice with curricular materials prior to 
the start of the program report feeling more prepared to teach the content. 


ACADEMIC TEACHERS 
Certified teachers with strong content knowledge and grade-level experience 
em enhance instructional quality in academic classes. Specialized support personnel 
We can enhance learning and provide greater continuity across the school year for 
students with specialized needs. 


™ Teacher quality has the largest school-based impact on student outcomes. Even over the summer, 
hiring certified academic teachers with strong content knowledge and grade-level experience 
enhances instructional quality in academic classes. 


= For programs serving students with specialized needs such as: English language learners, students 
with Individualized Education Plans, and students needing behavioral or mental health support, hiring 
specialized support personnel strengthens the academic support model. 
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ENRICHMENT INSTRUCTORS 
Enrichment lessons led by instructors with content expertise are more likely to 
oo we students. Partnerships with community organizations can create 
opportunity for additional personnel with specific expertise in distinctive enrichment 
activities. 


m= In the RAND research study, enrichment instructors with strong content knowledge more frequently 
demonstrated and modeled skills, corrected student techniques, and built on student strengths than 
instructors without expertise. 


= Multiple models of staffing for enrichment can be effective, including: 


o Hiring district teachers with the enrichment content expertise 
o Contracting directly with community-based enrichment providers 
o Establishing partnerships with community-based intermediaries who then hire local experts 


ADMINISTRATION 
In addition to site administrators, large, centralized summer programs require early 
oO and comprehensive planning from a half-time summer program director who can 
begin working in January, if not earlier. 


= Thorough planning is associated with key programming components. For example, ensuring both 
that teachers have necessary materials and that transportation runs smoothly from the first day 
supports teachers’ use of academic time and helps create a positive site climate. 


The average daily cost of a summer program is less than the average daily cost of a 
school day. 


= Based on five urban school districts’ summer programs, it costs about $1,400 per attendee to host a 
five-week, six-hour-per-day summer program that includes small classes of 15 or fewer students 
taught by certified teachers. The cost estimate includes daily academics, meals, transportation, and 
enrichment activities. 


Hiring staff to achieve desired ratios based on projected daily attendance, rather than 
staffing based on the number of students who enroll, can reduce costs. 


™ Even with active recruiting processes, some students will sign up for the program but not attend. In 
the National Summer Learning Project, in each summer approximately 20 percent of students signed 
up but did not attend one day. 
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Consider cost-efficiencies in the design of the program while weighing them against 
potential impacts on program quality. 
® Partner with community-based organizations that have their own funding sources 


m Determine the lowest feasible number of summer program sites given the need for small class sizes 
reasonable transportation times, and positive site climates 


® Centralize planning activities 
= Continue the summer program over time 


®™ Extend the school-year curricula instead of purchasing a new one for summer 


Consider additional effective supports that could be added to summer programming. 


™ Research on the benefits of high-dosage tutoring for intensive academic support suggests that 
summer students might also benefit from tutoring relationships in groups of fewer than four students. 


Additional support for recruiting and planning is available on The Wallace Foundation’s Knowledge Center. 


This brief is one in a series aimed at providing K-12 education decision-makers and advocates with an evidence 
base to ground discussions about how to best serve students during and following the novel coronavirus pandemic. 
Click here to learn more about the EdResearch for Recovery Project and view the set of COVID-19 response-and- 
recovery topic areas and practitioner-generated questions. To receive updates and the latest briefs, sign up here. 


Briefs in this series will address a broad range of COVID-19 challenges across five categories: 


Student Learning 

School Climate 
Supporting All Students 
Teachers 

Finances and Operations 


This EdResearch for Recovery Project brief is a collaboration among: 


ANNENBERG RESULTS 
SROWN UNIVERSITY “32 AMERICA AND 


CORPORATION 


Funding for this research was provided by the Bill & Melinda Gates Foundation. The findings and conclusions contained 
within are those of the authors and do not necessarily reflect positions or policies of the foundation. 
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